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TITLE OF THE INVENTION 
IMAGE SENSING APPARATUS FOR MICROSCOPE 

BACKGROUND OF THE INVENTION 
The present invention relates to an image sensing 
5 apparatus for a microscope, which senses and displays 

an observation image obtained from the microscope. 

FIG. 11 is a view showing the schematic structure 
of a conventional image sensing apparatus for a general 
microscope. FIG. 12 is a schematic view showing color 
10 balance adjustment for an image in transmission bright- 

field observation by this apparatus. 

In FIG. 11, an image sensing apparatus 101 is 
attached to the observation optical system of a 
microscope 100, and senses an observation image of a 
15 specimen enlarged by the microscope 100, The image 

sensing apparatus 101 performs photoelectric conversion 
and the like for the observation image, and displays 
the observation image data on a display unit 102. 

Color balance is generally uniformly adjusted for 
20 the entire region of observation image data. For 

example, the ratio of R (Red), G (Green), and B (Blue) 
in observation image data is uniformly changed over the 
entire display region. 

When a specimen is observed through the microscope, 
2 5 various microscopy techniques such as transmission 

bright-field observation and fluorescent observation 
are selected in accordance with the observation purpose 



for that specimen. However, upon switching the 
microscopy technique color balance is not adjusted in 
consideration of the switched microscopy technique. 
For example, originally color balance needs to be 
5 adjusted only for the stained portion of an observation 

specimen L in an image in transmission bright-field 
observation like the one shown in FIG. 12. However, 
color balance is uniformly adjusted for the entire 
region of observation image data. As a result, an 
10 achromatic background portion M, which need not be 

colored, is undesirably colored to degrade the image 
quality. 

Correcting observation image data later by image 
software or the like takes a long time. In addition, 
15 the operator must execute an extra operation such as 

designation of a region subjected to color balance 
adjustment. This demands an extra labor from the 
operator . 

When a specimen is to be observed through 
20 a microscope, the specimen surface is irradiated with 

a quantity of light appropriate for observation in 
accordance with the observation conditions of the 
specimen. At this time, the color temperature of the 
light source changes depending on adjusting (dimming) 
2 5 of illumination light which irradiates the specimen 

surface. Hence, to obtain a high-quality color image 
when an observation image is sensed through the 



microscope by the image sensing apparatus, white 
balance must be corrected for the sensed image so as to 
make the white balance uniform regardless of changes in 
color temperature of the light source adjusted (dimmed) 
in accordance with observation conditions • 

A known example of a conventional white balance 
correction method is automatically tracking white 
balance correction in which color balance prepared by 
averaging the entire display is corrected to always 
make it white • 

According to another white balance correction, 
when the color temperature changes with insertion/ 
removal of a filter or changes in light quantity of 
light source, the stage of the microscope is operated 
to remove the specimen from the image sensing field, 
and the entire display is made white • In this state, 
white balance correction is set. While this white 
balance correction value is held until next new setting, 
the observation image is sensed. 

However, in the method of setting white balance 
correction while making the entire display white, the 
microscope must be operated not to display any specimen 
image on the display in order to make the entire 
display white every time the color temperature of the 
light source changes with insertion/removal of a filter 
or light adjusting (dimming) . This greatly degrades 
the operator's operability* 



This white balance correction assumes that a 
chromatic signal obtained by averaging the colors of 
the entire display like a natural image is equivalent 
to a chromatic signal obtained when the entire display 
is white. That is, an observation image must contain 
respective colors on average. However, an observation 
image in microscopic observation ordinarily contains 
many magenta components or blue components depending on 
the specimen to be observed* In many cases, a specimen 
containing many components of a single color is 
observed. For example, when a specimen containing many 
magenta components is to be sensed, white balance 
correction cancels magenta. Then, the specimen portion 
fades, and the originally white portion is colored in 
green. 

Still another white balance correction method 
is disclosed in Jpn. Pat. Appln. KOKAI Publication 
No. 8-237679. This method adopts a mode in which white 
balance is corrected automatically following changes in 
light source or object, and a mode in which white 
balance is corrected in response to a trigger signal 
and the current white balance correction state is held 
until a next trigger is input. In each mode, the white 
balance correction range is defined by controlling the 
gains of R and B signals, and white balance is 
corrected within only this range. 

In white balance correction disclosed in Jpn. Pat. 



Appln. KOKAI Publication No. 8-237679, unnatural fading 
and coloring by white balance correction can be reduced 
by defining the gain adjustment range for performing 
correction. However, the above-described problems 
still arise in an object containing many components of 
a single color, like a specimen in microscopic 
observation. 

BRIEF SUMMARY OF THE INVENTION 
It is an object of the present invention to 
provide an image sensing apparatus for a microscope, 
which can provide a smooth observation environment 
without demanding any extra labor of an operator in 
sensing an observation image obtained from the 
microscope . 

An image sensing apparatus for a microscope of 
this invention comprises an image sensing unit for 
sensing an observation image obtained by a microscope 
and obtaining the observation image, a microscopy 
technique determination unit for detecting a microscopy 
technique in the microscope, a chromaticity deter- 
mination unit for determining chromaticity of the 
observation image on the basis of the microscopy 
technique detected by the microscopy technique 
determination unit, and determining a region where 
color balance is adjusted in the observation image, and 
a color balance adjustment unit for adjusting color 
balance in accordance with a color balance adjustment 



amount arbitrarily set for the region of the 
observation image determined by the chromatic ity 
determination unit. 

Additional objects and advantages of the invention 
will be set forth in the description which follows, and 
in part will be obvious from the description, or may be 
learned by practice of the invention. The objects and 
advantages of the invention may be realized and 
obtained by means of the instrumentalities and 
combinations particularly pointed out hereinafter. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

The accompanying drawings , which are incorporated 
in and constitute a part of the specification, 
illustrate presently preferred embodiments of the 
invention, and together with the general description 
given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the invention. 

FIG. 1 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
according to a first embodiment of the present 
invention; 

FIG. 2 is a view showing a display example of 
an observation image on a display unit in the image 
sensing apparatus for a microscope according to the 
first embodiment of the present invention; 

FIG. 3 is a view showing an image sensed and 



printed in transmission bright-field observation that 
is displayed on the display unit in the image sensing 
apparatus for a microscope according to the first 
embodiment of the present invention; 

FIG, 4 is a view showing an image sensed and 
printed in fluorescent observation that is displayed 
on the display unit in the image sensing apparatus for 
a microscope according to the first embodiment of the 
present invention; 

FIG. 5 is a graph showing the luminance 
distribution of observation image data obtained by 
a luminance distribution determination unit in 
the image sensing apparatus for a microscope according 
to the first embodiment of the present invention; 

FIG. 6 is a graph showing the result of expanding 
the tone of an intermediate-luminance range represent- 
ing the fluorescence of a specimen by a tone adjustment 
unit in the image sensing apparatus for a microscope 
according to the first embodiment of the present 
invention; 

FIG. 7 is a graph showing the luminance 
distribution of observation image data obtained by 
the luminance distribution determination unit in the 
image sensing apparatus for a microscope according to 
the first embodiment of the present invention; 

FIG. 8 is a graph showing the result of expanding 
the tone of a low- or intermediate-luminance range 



representing the stained portion of a specimen by 
the tone adjustment unit in the image sensing apparatus 
for a microscope according to the first embodiment of 
the present invention; 

FIG, 9 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
according to a second embodiment of the present 
invention; 

FIG, 10 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
according to a third embodiment of the present 
invention; 

FIG. 11 is a view showing the structure of a 
conventional image sensing apparatus for a microscope; 
and 

FIG. 12 is a view showing color balance adjustment 
for an image in transmission bright-field observation 
in the conventional image sensing apparatus for a 
microscope . 

DETAILED DESCRIPTION OF THE INVENTION 

FIG. 1 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
according to the first embodiment of the present 
invention. This image sensing apparatus is constituted 
by a microscope 1 which can be switched to various 
microscopy techniques such as transmission bright-field 
observation and fluorescent observation, and image 



sensing apparatus 2 for sensing an observation image 
obtained by the microscope 1 . 

The microscope 1 comprises a transmission 
observation optical system 3 and incident-light 
or episcopic observation optical system 4. The 
transmission observation optical system 3 has a 
transmission light source 5, A collector lens 6 
for collecting transmission lights transmission 
filter unit 1 , transmission field diaphragm (stop) 8, 
deflecting mirror 9, transmission aperture diaphragm 
(stop) 10, condenser optical element unit 11, and top 
lens unit 12 are arranged on the optical path of 
transmission light emitted by the transmission light 
source 5. The incident-light observation optical 
system 4 has an incident light source 13, An incident- 
light filter unit 14, incident-light shutter 15, 
incident-light field diaphragm (stop) 16, and incident- 
light aperture diaphragm (stop) 17 are arranged on the 
optical path of incident light emitted by the incident 
light source 13, 

A specimen stage 18 on which a specimen to be 
observed is placed, revolver 2 0 which has a plurality 
of objective lenses 19 and revolves to select one 
objective lens 19 and position it on an observation 
optical path S, cube unit 21 for switching a dichroic 
mirror on the observation optical path S in accordance 
with a microscopy technique such as transmission 



bright-field observation or fluorescent observation, 
and beam splitter 22 for splitting the observation 
optical path S into an eyepiece lens side path and 
image sensing apparatus side path are inserted on the 
observation optical path S on which the optical axes of 
the transmission observation optical system 3 and 
incident-light observation optical system 4 overlap 
each other. 

The respective units of the transmission 
observation optical system 3 and incident-light 
observation optical system 4, specimen stage 18, 
revolver 20, and cube unit 21 are motorized, and driven 
by respective motors (not shown) by driving signals 
from a driving circuit 23 • 

A microscope controller 24 controls the whole 
operation of the microscope 1, and is connected to the 
transmission light source 5, incident light source 13, 
and driving circuit 23. The microscope controller 24 
outputs a control instruction to the driving circuit 23 
in accordance with the operation of an operation unit 
(not shown) by an operator such as switching of the 
observation magnification, light adjusting (dimming), 
or switching of the microscopy technique. Further, the 
microscope controller 24 has a function of adjusting 
(dimming) the transmission light source 5 and incident 
light source 13. 

The microscope controller 2 4 has a microscopy 



technique determination function of receiving from 
the operator via the operation unit (not shown) an 
instruction of switching the microscopy technique such 
as transmission bright-field observation or fluorescent 
observation, detecting the current microscopy technique 
and sending the microscopy technique information to the 
image sensing apparatus 2. The microscope controller 
24 detects the current microscopy technique by 
detecting a light source in use or a unit driven by 
the driving circuit 23. 

In the image sensing apparatus 2, an image 
sensor 31 for sensing a color image is located on 
the observation optical path S of the microscope 1. 
The image sensor 31 senses the observation image 
of a specimen enlarged by the microscope 1, and 
photoelectrically converts the image. The output 
terminal of the image sensor 31 is connected to a 
pre-processor 32. The pre-processor 32 has a function 
of converting an output signal from the image sensor 31 
into a video signal, and separating the video signal 
into signals of respective R (Red), G (Green), and B 
(Blue) colors. 

The R, G, and B color signals separated by the 
pre-processor 32 are respectively input to variable 
gain amplifiers 33a, 33b, and 33c. The variable gain 
amplifiers 33a, 33b, and 33c correct white balance by 
amplifying the R, G, and B color signals in accordance 



with the gains set by a gain setting unit 34. 

Outputs from the variable gain amplifiers 33a, 33b, 
and 33c are input to an A/D converter 35 where they are 
converted into digital signals. The digital signals 
are input to a frame memory 36 as digital image data. 
The frame memory 36 stores image data corresponding 
to one frame of an observation image sensed by the 
image sensor 31. The frame memory 36 is connected to 
a memory controller 37, which, in turn, is connected 
to a position designation unit 3 8 and white balance 
detector 39. The white balance detector 39 is 
connected to the gain setting unit 34 and a white 
balance setting unit 49. Note that it is also possible 
to omit the variable gain amplifier 33b and input a G 
color signal separated by the pre-processor 32 directly 
to the A/D converter 35. In this case, white balance 
is corrected by amplifying R and B color signals by the 
variable gain amplifiers 33a and 33c in accordance with 
the gains set by the gain setting unit 34. 

The memory controller 37 outputs to the frame 
memory 3 6 a control signal for writing an image signal 
from the A/D converter 35 in the frame memory 36, and a 
control signal for reading out image data stored in the 
frame memory 36 to a color balance adjustment unit 40 
and chromaticity determination unit 41. The position 
designation unit 38 inputs index data to the frame 
memory 3 6 via the memory controller 37, and displays 



an arrow A in, e.g., an observation image on a display 
unit 48 shown in FIG. 2. The position designation 
unit 38 moves the arrow A in the observation image in 
accordance with the operation of a connected mouse and 
the like (not shown) by the operator. The operator 
operates the mouse to move the arrow A, thereby 
designating the tip portion of the arrow A as a white 
portion subjected to white balance detection. 

The white balance detector 39 receives, from 
the frame memory 36 via the memory controller 37, 
image data corresponding to the region of the white 
portion designated by the operator from the position 
designation unit 38. Using the image data, the white 
balance detector 39 detects white balance. Note that 
the region corresponds to 6 x 6 = 36 pixels having 
the tip of the arrow A as a center. Of course, 
an arbitrary region of 4 x 4 pixels, 5X5 pixels, 
8X8 pixels, or the like can be properly designated. 
It is also possible for the operator to use the arrow A 
as an enlargement/reduction pointer in the observation 
image and move the arrow A while dragging with the 
mouse, thereby designating an arbitrary region. 

When white balance is good (satisfied), the white 
balance detector 39 holds the gains of the variable 
gain amplifiers 33a, 33b, and 33c set in the gain 
setting unit 34 at that time. When white balance is 
lost, the white balance detector 3 9 sets the gains of 
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the variable gain amplifiers 33a, 33b, and 33c set 
in the gain setting unit 34 in accordance with the 
detection results of the white balance detector 39 in 
order to correct the white balance. When white balance 
5 is good, the ratio R : G : B of the respective colors 

output from the variable gain amplifiers 33a, 33b, and 
33c is 1 : 1 : 1. 

Observation image data stored in the frame memory 
3 6 is sent to the color balance adjustment unit 4 0 and 

10 chromaticity determination unit 41 by the memory 

controller 37* The chromaticity determination unit 41 
has a function of receiving microscopy technique 
information from the microscope controller 24, 
determining the chromaticity of each pixel of 

15 observation image data on the basis of the microscopy 

technique information, and determining a region 
subjected to color balance adjustment in units 
of pixels* The color balance adjustment unit 40 
has a function of adjusting color balance for the 

2 0 pixels of the determined region on the basis of 

the region subjected to color balance adjustment 
as the determination result of the chromaticity 
determination unit 41, More specifically, the color 
balance adjustment unit 40 adjusts the ratio of the 

2 5 respective colors R : G : B. The adjustment amount of 

the ratio of R : G : B can be changed in accordance 
with an amount input by the operator from an adjustment 



- 15 



amount input unit 42. The color balance adjustment 
unit 4 0 is connected to a tone adjustment unit 44 and 
luminance distribution determination unit 43. 

Observation image data having undergone color 
5 balance adjustment by the color balance adjustment 

unit 40 is sent via the tone adjustment unit 44, 
a display processor 46, and a D/A converter 47 to 
a display unit 48 which displays an image. The display 
processor 46 processes input image data into a signal 

10 suitable for the display image size and display speed 

of the display unit 48, and outputs the signal to 
the D/A converter 47. The display unit 48 displays 
an observation image converted into an analog signal by 
the D/A converter 47. 

15 The luminance distribution determination unit 43 

has a function of receiving microscopy technique 
information from the microscope controller 24, 
calculating the luminance distribution of the 
respective pixels of observation image data based on 

2 0 the microscopy technique information, and determining 

a region subjected to tone (contrast) correction 
in the observation image data from the luminance 
distribution. The tone adjustment unit 44 has 
a function of correcting tone (contrast) in accordance 

25 with an arbitrarily set tone correction amount for 

a region subjected to tone correction in observation 
image data that is determined by the luminance 
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distribution determination unit 43 • In this case, the 
tone correction amount can be changed in accordance 
with an amount input by the operator from an adjustment 
amount input unit 45. 
5 Observation image data having undergone tone 

adjustment by the tone adjustment unit 44 is sent via 
the display processor 46 and D/A converter 47 to the 
display unit 48 which displays an image. 

A case in which color balance is adjusted in 

10 transmission bright-field observation will be explained 

as the first operation example of the image sensing 
apparatus for a microscope having the above arrangement. 
The operator sets the microscopy technique to the 
transmission bright-field observation method, and 

15 sets the observation magnification and the like from 

an operation unit (not shown) to the microscope 
controller 24. 

When the microscope controller 24 determines that 
the microscopy technique is set to the transmission 

20 bright-field observation method, the controller 24 

turns on the transmission light source 5 to a set 
brightness, and turns off the incident light source 13. 
The microscope controller 2 4 issues a control instruc- 
tion to the driving circuit 2 3 so as to set the 

25 transmission bright-field observation microscopy 

technique and observation magnification set by the 
operator . 



The driving circuit 2 3 drives the revolver 2 0 so 
as to locate on the observation optical path S an 
objective lens 19 having the magnification instructed 
by the microscope controller 24. At the same time, the 
driving circuit 23 drives the cube unit 21 so as to 
locate a transmission observation dichroic mirror on 
the observation optical path S. The driving circuit 23 
controls the transmission aperture diaphragm 10, 
condenser optical element unit 11, and top lens unit 12 
to transmission observation settings, and drives the 
transmission filter unit 7 and transmission field 
diaphragm 8 • 

In this state, transmission light emitted by the 
transmission light source 5 is collected by the 
collector lens 6, reflected by the deflecting mirror 9 
via the transmission filter unit 7 and transmission 
field diaphragm 8, and irradiates a specimen (not 
shown) placed on the specimen stage 18 via the 
transmission aperture diaphragm 10, condenser optical 
element unit 11, and top lens unit 12, The light 
transmitted through the specimen is projected as an 
observation image on the image sensor 31 of the image 
sensing apparatus 2 via the objective lens 19, cube 
unit 21, and beam splitter 22. 

The image sensor 31 photoelectrically converts the 
projected observation image, and outputs the electrical 
signal to the pre-processor 32. The pre-processor 32 
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converts the electrical signal from the image sensor 31 
into a video signal, separates the video signal into 
G, and B color signals, and outputs them* The output 
signals of the respective R, G, and B colors from the 
5 pre-processor 32 are A/D-converted by the A/D converter 

35 via the variable gain amplifiers 33a, 33b, and 33c, 
and sent to the frame memory 36, and stored in it as 
digital observation image data. The observation image 
data stored in the frame memory 3 6 is read out to the 

10 chromaticity determination unit 41 and color balance 

adjustment unit 40 by the memory controller 37. 

The chromaticity determination unit 41 receives 
speculum information sent from the microscope 
controller 24, and determines chromaticity for 

15 each pixel of the observation image data input from 

the frame memory 36 on the basis of the speculum 
information. The chromaticity is determined in 
accordance with whether the signal level of the 
respective R, G, and B colors and the ratios (R/G) 

20 and (B/G) of the luminances of the respective colors 

satisfy relations (1) to (4): 

Wrl < R/G < Wr2 •••(!) 
Wbl < B/G < Wb2 • * • (2 ) 

R > Rth • • • ( 3 ) 

25 B > Bth . * • (4) 

where Wrl, Wr2, Wbl, and Wb2 are values set for 
various microscopy techniques. For example, Wrl = 0.8, 
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Wr2 = 1.2 r Wbl = 0.8, and Wb2 == 1.2 are values 
when an achromatic background portion is selected 
in transmission bright-field observation. Rth and Bth 
are thresholds for the magnitudes of the R and B 
5 signals, respectively, and have, e.g., a value 50% of 

the maximum amplitude. 

The chromaticity determination unit 41 determines 
chromaticity for each pixel of observation image data 
using the chromaticity determination relations (1) 

10 to (4). When the chromaticity satisfies all the 

relations (1) to (4), the pixel is determined to be 
white. By determining chromaticity for all the pixels 
of observation image data, a white, achromatic portion 
in observation image data, i.e., the background of 

15 an image in transmission bright-field observation is 

determined. The region corresponding to a background 
(a white, achromatic portion) is determined as a region 
to which the color balance adjustment is not performed, 
and a region or regions other than the above region are 

20 determined as a region to be subjected to the color 

balance adjustment . 

The color balance adjustment unit 40 receives 
information about the region subjected to color 
balance adjustment as the determination result of the 

25 chromaticity determination unit 41, and adjusts the 

ratio of the respective colors R : G : B for each pixel 
of the region on the basis of an adjustment amount 
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input by the operator from the adjustment amount input 
unit 42, thereby adjusting color balance. 

In this apparatus, the color balance adjustment 
amount can be changed based on a value input by the 
5 operator through the adjustment amount input unit 42. 

Alternatively, the determination color of the 
chromaticity determination unit 41 may be changed 
through the adjustment amount input unit 42. 

Observation image data having undergone color 

10 balance adjustment by the color balance adjustment 

unit 40 is sent via the tone adjustment unit 44, 
display processor 46, and D/A converter 47 to the 
display unit 48. The display unit 48 displays an image 
corresponding to the observation image data as shown in 

15 FIG. 3. In the first operation example, the luminance 

distribution determination unit 43 and tone adjustment 
unit 44 do not process observation image data. In the 
observation image displayed on the display unit 48, 
color balance is adjusted for the specimen region 301 

2 0 but is not adjusted for the achromatic background 

portion 302. An observation image in FIG. 3 exhibits 
good color balance at red portions 3 01a, 301b, 301c, 
and the like of the specimen. 

A case in which color balance is adjusted in 

25 fluorescent observation will be explained as the second 

operation example of the image sensing apparatus for a 
microscope having the above arrangement. The operator 
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sets the microscopy technique to the fluorescent 
observation method, and sets the observation 
magnification and the like from an operation unit 
(not shown) to the microscope controller 24, 
5 When the microscope controller 24 determines 

that the microscopy technique (method) is set to the 
fluorescent observation method, the controller 24 turns 
on the incident light source 13 to a set brightness, 
and turns off the transmission light source 5, The 

10 microscope controller 24 issues a control instruction 

to the driving circuit 23 so as to set the fluorescent 
observation microscopy technique and observation 
magnification set by the operator. 

The driving circuit 23 drives the revolver 20 so 

15 as to locate on the observation optical path S an 

objective lens 19 having the magnification instructed 
by the microscope controller 24. At the same time, the 
driving circuit 23 drives the cube unit 21 so as to 
locate a fluorescent observation dichroic mirror on the 

20 observation optical path S. The driving circuit 23 

drives the incident-light filter unit 14, incident- 
light shutter 15, incident-light field diaphragm 16, 
and incident-light aperture diaphragm 17. 

In this state, incident light emitted by the 

2 5 incident light source 13 irradiates a specimen 

(not shown) placed on the specimen stage 18 via the 
incident-light filter unit 14, incident-light shutter 
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15, incident-light field diaphragm 16, incident-light 
aperture diaphragm 17, fluorescent observation dichroic 
mirror of the cube unit 21, and objective lens 19. 
When the specimen is irradiated with incident light, 
5 the specimen emits fluorescence. The fluorescence 

emitted by the specimen is projected as an observation 
image on the image sensor 31 of the image sensing 
apparatus 2 via the objective lens 19, cube unit 21, 
and beam splitter 22. 

10 The image sensor 31 photoelectrically converts the 

projected observation image, and outputs the electrical 
signal to the pre-processor 32. The pre-processor 32 
converts the electrical signal from the image sensor 31 
into a video signal, separates the video signal into R, 

15 G, and B color signals, and outputs them. The output 

signals of the respective R, G, and B colors from the 
pre-processor 32 are A/D-converted by the A/D converter 
35 via the variable gain amplifiers 33a, 33b, and 33c, 
sent to the frame memory 36, and stored in it as 

20 digital observation image data. The observation image 

data stored in the frame memory 36 is read out to the 
chromaticity determination unit 41 and color balance 
adjustment unit 40 by the memory controller 37. 

The chromaticity determination unit 41 receives 

25 speculum information sent from the microscope 

controller 24, and determines chromaticity for each 
pixel of the observation image data input from 
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the frame memory 36 on the basis of the speculum 
information. The chromaticity determination unit 41 
determines chromaticity for each pixel of observation 
image data based on a predetermined criterion, and 
5 determines a blacky achromatic region in the 

observation image data obtained by fluorescent 
observation. In this case, for example, a value equal 
to 20% of the maximum amplitude of the signal level is 
set as the criterion. The region having a signal level 

10 smaller than the criterion is determined as a black, 

achromatic region. 

The color balance adjustment unit 40 receives 
information about the region subjected to color 
balance adjustment as the determination result of 

15 the chromaticity determination unit 41, and adjusts 

the ratio of the respective colors R : G : B for each 
pixel of the region on the basis of an adjustment 
amount input by the operator from the adjustment amount 
input unit 42, thereby adjusting color balance. 

2 0 Observation image data having undergone color 

balance adjustment by the color balance adjustment 
unit 40 is sent via the tone adjustment unit 44, 
display processor 46, and D/A converter 47 to the 
display unit 48 which displays an image. The display 

25 unit 48 displays an image corresponding to the 

observation image data as shown in FIG. 4. In the 
second operation example, the luminance distribution 
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determination unit 43 and tone adjustment unit 44 do 
not process observation image data* In the observation 
image displayed on the display unit 48, color balance 
is adjusted for the specimen region 401 but is 
5 not adjusted for the black achromatic portion 4 02 

serving as the background in fluorescent observation • 
An observation image in FIG* 4 exhibits good color 
balance at green portions (401), and the like of the 
specimen. 

10 In the first and second operation examples, the 

microscopy technique of the microscope 1 is detected 
by the microscope controller 24, the chromaticity 
of observation image data is determined by the 
chromaticity determination unit 41 based on the 

15 detected microscopy technique, and a region subjected 

to color balance adjustment in the observation image 
data is determined* The determined region of the 
observation image data undergoes color balance 
adjustment by the color balance adjustment unit 40 in 

2 0 accordance with a color balance adjustment amount set 

from the adjustment amount input unit 42. 

In transmission bright-field observation, color 
balance can be selectively adjusted for a portion 
except for an achromatic background portion in 

2 5 observation image data, i.e., a specimen region. 

Therefore, while maintaining the color balance (white) 
of the achromatic background portion, the operator can 
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easily, arbitrarily change color balance only for the 
stained portion of a specimen under observation. This 
enables excellent transmission bright-field observation. 
Also in fluorescent observation, color balance can be 
5 adjusted for a specimen region, and is not adjusted for 

a black, achromatic portion serving as the background. 
Accordingly, a smooth observation environment 
corresponding to each microscopy technique can be 
provided without demanding any extra labor of the 

10 operator. 

In the first and second operation examples, the 
criterion for determining chromaticity for each pixel 
of observation image data is set for each microscopy 
technique. Instead, a plurality of criteria may be set 

15 based on not only the microscopy technique but also 

filter information, light quantity information, 
objective lens information, and the like. 

The image sensing apparatus shown in FIG. 1 is 
constituted by the microscope 1 which can be switched 

20 to various microscopy techniques such as transmission 

bright-field observation and fluorescent observation, 
and image sensing apparatus 2 for sensing an 
observation image obtained by the microscope 1 . In the 
image sensing apparatus 2, an electrical signal output 

25 from the image sensor 31 is converted into a video 

signal by the pre-processor 32, the video signal is 
A/D-converted by the A/D converter 35 via the variable 
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gain amplifiers 33a, 33b, and 33c, and then the digital 
signal is stored as observation image data in the frame 
memory 36. This observation image data is sent to the 
luminance distribution determination unit 43 and tone 
5 adjustment unit 44 via the color balance adjustment 

unit 40. 

A case in which tone is adjusted in fluorescent 
observation will be explained as the third operation 
example of the image sensing apparatus for a microscope 

10 having the above arrangement. Note that the basic 

operation of the microscope 1 in fluorescent 
observation is the same as in the second operation 
example. The operator sets the microscopy technique 
to the fluorescent observation method, and sets the 

15 observation magnification from an operation unit (not 

shown) to the microscope controller 24. 

When the microscope controller 24 determines that 
the microscopy technique is set to the fluorescent 
method, the controller 24 turns on the incident light 

2 0 source 13 to a set brightness, and turns off the 

transmission light source 5. In addition, the 
microscope controller 24 issues a control instruction 
to the driving circuit 23 so as to set the fluorescent 
observation method as the designated microscopy 

2 5 technique and the observation magnification. 

The driving circuit 23 drives the cube unit 21 so 
as to enable observation using desired excited light. 
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Further, the driving circuit 23 drives the incident- 
light filter unit 14, incident-light shutter 15, 
incident-light field diaphragm 16, and incident-light 
aperture diaphragm 17. 
5 In this state, incident light emitted by the 

incident light source 13 irradiates a specimen (not 
shown) placed on the specimen stage 18 via the 
incident-light filter unit 14, incident-light shutter 
15, incident-light field diaphragm 16, incident-light 

10 aperture diaphragm 17, fluorescent observation dichroic 

mirror of the cube unit 21, and objective lens 19. 
Upon being irradiated with the incident light, the 
specimen emits fluorescence* The fluorescence emitted 
by the specimen is projected as an observation image on 

15 the image sensor 31 of the image sensing apparatus 2 

via the objective lens 19, cube unit 21, and beam 
splitter 22, 

The image sensor 31 photoelectrically converts the 
projected observation image, and outputs the electrical 

20 signal to the pre-processor 32. The pre-processor 32 

converts the electrical signal from the image sensor 31 
into a video signal, separates the video signal into R, 
G, and B color signals, and outputs them. The output 
signals of the respective R, G, and B colors from the 

25 pre-processor 32 are A/D-converted by the A/D converter 

35 via the variable gain amplifiers 33a, 33b, and 33c, 
sent to the frame memory 36, and stored in it as 
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digital observation image data. The observation image 
data stored in the frame memory 36 is read out to the 
luminance distribution determination unit 43 and tone 
adjustment unit 44 via the color balance adjustment 
5 unit 40 by the memory controller 37. 

The luminance distribution determination unit 4 3 
receives microscopy technique information sent from the 
microscope controller 24, calculates the luminance 
distribution of the respective pixels of observation 

10 image data input from the frame memory 3 6 on the 

basis of the microscopy technique information, and 
determines a region subjected to tone correction in the 
observation image data from the luminance distribution. 
Determination of the luminance distribution will 

15 be described in detail. According to the determination 

method, a luminance component Y is extracted from the 
respective R, G, and B colors of observation image data, 
and a tone correction amount is selected from the 
luminance component Y. The tone correction amount at 

2 0 this time is set for each microscopy technique by the 

operator from the adjustment amount input unit 45. 

For example, in the luminance distribution of 
observation image data in fluorescent observation shown 
in FIG. 5, a peak appears in a low-luminance range a, 

25 and a peak also appears in an intermediate-luminance 

range b. In this case, the peak in the low-luminance 
range a is attributed to the pixel value of the 
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background of an observation image, and the peak in the 
intermediate- luminance range b is attributed to the 
pixel value of the fluorescence from the specimen. 

To correct tone for such observation image data, 
5 a correction amount is selected by which the tone in 

the intermediate- luminance range b representing 
the fluorescence of the specimen is expanded without 
correcting tone in the low-luminance range a. 
Therefore, the luminance distribution determination 

10 unit 43 determines a region subjected to tone 

correction in observation image data, e.g», the 
intermediate-luminance range b representing 
fluorescence of the specimen from the luminance 
distribution of the observation image data using 

15 a luminance kl as the boundary, as shown in FIGS. 5 

and 6 . 

The tone adjustment unit 44 corrects tone for 
a region (intermediate-luminance range b) subjected 
to tone correction in observation image data that is 

2 0 determined by the luminance distribution determination 

unit 43, in accordance with a tone correction amount 
input by the operator from the adjustment amount input 
unit 45. As a result of tone correction, the luminance 
distribution of observation image data is changed such 

25 that tone is not corrected in the low-luminance range a 

serving as a region where no fluorescence is emitted, 
and the tone of the intermediate-luminance range b 
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representing the fluorescence of the specimen is 
expanded, as shown in FIG. 6. The observation image 
data having undergone tone correction by the tone 
adjustment unit 44 is output via the display processor 
5 46 and D/A converter 47 to the display unit 48 which 

displays an image* As is apparent from FIG. 4^ the 
tone of the intermediate-luminance range (401) 
representing the fluorescence of the specimen is 
expanded except for the low- luminance range (402) 

10 serving as a region where no fluorescence is emitted. 

In the third operation example, the color balance 
adjustment unit 40 and chromaticity determination 
unit 41 do not process observation image data. However, 
an observation image can be displayed in which color 

15 balance is adjusted as in the second operation example, 

and tone is adjusted as in the third operation example. 

A case in which tone is adjusted in transmission 
bright-field observation will be explained as the 
fourth operation example of the image sensing apparatus 

2 0 for a microscope having the above arrangement. Note 

that the basic operation of the microscope 1 in 
transmission bright-field observation is the same 
as in the first operation example. The operator sets 
the microscopy technique to the transmission bright- 

25 field observation method, and sets the observation 

magnification from an operation unit (not shown) to 
the microscope controller 24. 
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When the microscope controller 24 determines that 
the microscopy technique is set to the transmission 
bright-field observation method, the controller 24 
turns on the transmission light source 5 to a set 
5 brightness, and turns off the incident light source 13, 

In addition, the microscope controller 24 issues a 
control instruction to the driving circuit 23 so as to 
set the transmission bright-field observation method as 
the designated microscopy technique and the observation 

10 magnification* 

The driving circuit 23 controls the cube unit 21, 
transmission aperture diaphragm 10, condenser optical 
element unit 11, and top lens unit 12 to transmission 
observation settings, and drives the transmission 

15 filter unit 7 and transmission field diaphragm 8, 

In this state, transmission light emitted by 
the transmission light source 5 is collected by the 
collector lens 6, and irradiates a specimen (not shown) 
placed on the specimen stage 18 via the transmission 

20 filter unit 7, transmission field diaphragm 8, deflect- 

ing mirror 9, transmission aperture diaphragm 10, 
condenser optical element unit 11, and top lens unit 12. 
The light transmitted through the specimen is projected 
as an observation image on the image sensor 31 of the 

25 image sensing apparatus 2 via the objective lens 19, 

cube unit 21, and beam splitter 22. 

The image sensor 31 photoelectrically converts the 
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projected observation image, and outputs the electrical 
signal to the pre-processor 32. The pre-processor 32 
converts the electrical signal from the image sensor 31 
into a video signal, separates the video signal into R, 
5 G, and B color signals, and outputs them. The output 

signals of the respective R, G, and B colors from the 
pre-processor 32 are A/D-converted by the A/D converter 
35 via the variable gain amplifiers 33a, 33b, and 33c, 
sent to the frame memory 36, and stored in it as 

10 digital observation image data* The observation image 

data stored in the frame memory 3 6 is read out to the 
luminance distribution determination unit 43 and tone 
adjustment unit 44 via the color balance adjustment 
unit 4 0 by the memory controller 37. 

15 The luminance distribution determination unit 43 

receives microscopy technique information sent from the 
microscope controller 24, calculates the luminance 
distribution of the respective pixels of observation 
image data input from the frame memory 36 on the 

2 0 basis of the microscopy technique information, and 

determines a region subjected to tone correction in the 
observation image data from the luminance distribution. 

Determination of the luminance distribution will 
be described in detail. According to the determination 

2 5 scheme, the luminance component Y is extracted from the 

respective R, G, and B colors of observation image 
data, and a tone correction amount is selected from the 
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luminance component The tone correction amount at 

this time is set for each microscopy technique by the 
operator from the adjustment amount input unit 43, 
For example, in transmission bright-field 
5 observation shown in FIG. 7, a peak appears in a 

high-luminance range c, and several peaks appear in 
a low- or intermediate-luminance range d in the 
luminance distribution of observation image data. 
In this case, the peak in the high-luminance range c is 

10 attributed to the pixel value of the background of an 

observation image, and the several peaks in the low- or 
intermediate-luminance range d are attributed to the 
pixel values of the stained portion of the specimen. 

To correct tone for this observation image data, a 

15 correction amount is selected by which the tone in the 

low- or intermediate-luminance range d representing the 
stained portion of the specimen is expanded without 
correcting tone in the high-luminance range c serving 
as the background of the observation image. Therefore, 

2 0 the luminance distribution determination unit 43 

determines a region subjected to tone correction in 
observation image data, e.g., the low- or intermediate- 
luminance range d representing the stained portion of 
the specimen from the luminance distribution of the 

25 observation image data using a luminance k2 as the 

boundary, as shown in FIGS. 7 and 8. 

The tone adjustment unit 44 corrects tone for 
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a region (low- or intermediate-luminance range d) 
subjected to tone correction in observation image data 
that is determined by the luminance distribution 
determination unit 43, in accordance with a tone 
5 correction amount input by the operator from the 

adjustment amount input unit 45, As a result of tone 
correction, the luminance distribution of observation 
image data is changed such that tone is not corrected 
in the high-luminance range c representing the 

10 background of the observation image, and the tone of 

the low- or intermediate-luminance range d representing 
the stained portion of the specimen is expanded, as 
shown in FIG. 8. The observation image data having 
undergone tone correction by the tone adjustment unit 

15 44 is output via the display processor 46 and D/A 

converter 47 to the display unit 48 which displays an 
image. As is apparent from FIG. 3, the tone of the 
intermediate-luminance range (301) representing the 
stained portion of the specimen is expanded except for 

2 0 the high-luminance range (302) representing the 

background of the observation image. 

In the fourth operation example, the color balance 
adjustment unit 4 0 and chromaticity determination 
unit 41 do not process observation image data. However 

25 an observation image can be displayed in which color 

balance is adjusted as in the first operation example, 
and tone is adjusted as in the fourth operation example 
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In the third and fourth operation examples, 
the microscopy technique of the microscope 1 is 
detected by the microscope controller 24, the luminance 
distribution of observation image data is obtained by 
5 the luminance distribution determination unit 43 based 

on the detected microscopy technique, and a region 
subjected to tone correction in the observation image 
data is determined from the luminance distribution. 
The determined region of the observation image data 

10 undergoes tone correction by the tone adjustment 

unit 44 in accordance with a color balance adjustment 
amount input from the adjustment amount input unit 45. 

In fluorescent observation, tone can be 
selectively corrected for the intermediate-luminance 

15 range b of observation image data subjected to 

fluorescence observation, i.e., fluorescence from 
a specimen. The operator can easily and arbitrarily 
correct tone only for the fluorescence of the specimen 
to be actually observed except for the low-luminance 

2 0 range a serving as the background which need not be 

corrected. This enables excellent fluorescent 
observation. 

In transmission bright-field observation, tone can 
be selectively corrected for the low- or intermediate- 
25 luminance range d of observation image data subjected 

to transmission bright-field observation. The operator 
can easily and arbitrarily correct tone only for the 
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stained portion of the specimen to be actually observed 
except for the high- luminance range c serving as the 
background which need not be corrected* This enables 
excellent transmission bright-field observation. 
5 Hence, tone can be easily adjusted in accordance 

with various microscopy techniques such as fluorescent 
observation and transmission bright-field observation 
in sensing an observation image from the microscope* 
A smooth observation environment corresponding to each 

10 microscopy technique can be provided without demanding 

any extra labor from the operator. 

A case in which white balance is corrected in 
transmission bright-field observation will be described 
as the fifth operation example of the image sensing 

15 apparatus for a microscope having the above arrangement. 

Note that the basic operation of the microscope 1 in 
transmission bright-field observation is the same as in 
the first operation example. 

When a specimen is observed through the microscope 

2 0 1, the observation image is projected on the image 

sensor 31 of the image sensing apparatus 2 and 
sensed by the image sensor 31. The image sensor 31 
photoelectrically converts the projected observation 
image, and outputs the electrical signal to the 

25 pre-processor 32. The pre-processor 32 converts the 

electrical signal from the image sensor 31 into a video 
signal, separates the video signal into R, G, and B 
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color signals, and outputs them. The output signals 
of the respective R, G, and B colors from the 
pre-processor 32 are input to the variable gain 
amplifiers SSa, 33b, and 33c where the signals are 
5 amplified in accordance with gains set by the gain 

setting unit 34 • The respective color signals from the 
variable gain amplifiers 33a, 33b, and 33c are input 
to the A/D converter 35, and converted into digital 
signals. The digital signals are sent to the frame 

10 memory 36, and stored in it as digital image data- The 

observation image data stored in the frame memory 36 is 
processed into a signal suitable for the display image 
size and display speed of the display unit 48 by the 
display processor 4 6 via the color balance adjustment 

15 unit 40 and the tone adjustment unit 44. The resultant 

signal is converted into an analog signal by the D/A 
converter 47, and displayed as an observation image on 
the display unit 48. 

While the observation image is displayed on the 

2 0 display unit 48, like a display example shown in FIG. 2, 

the operator inputs index data from the position 
designation unit 38 to the frame memory 36 via the 
memory controller 37. More specifically, the operator 
displays the arrow A in the observation image shown in 

25 FIG. 2 with a mouse (not shown) or the like, and 

designates a white portion subjected to white balance 
detection with the arrow A. 
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Then, image data corresponding to the white 
portion designated by the position designation unit 3 8 
is read out from the frame memory 36 to the white 
balance detector 39 by the memory controller 37. The 
5 white balance detector 39 detects white balance based 

on the image data. 

If white balance is good as a result of detection 
p by the white balance detector 39, (When white balance 

is good, the R,G and B color signals output from 
iVi 10 the variable gain amplifiers 33a, 33b, and 33c are 

'^l 1 : 1 : 1 in ratio.) the gains of the variable gain 

amplifiers 33a, 33b, and 33c set in the gain setting 
^ unit 34 are held without any change. If white balance 

^"^^ is lost, the gain settings of the variable gain 

O 15 amplifiers 33a, 33b, and 33c are changed by the gain 

setting unit 34 to correct white balance. When the 
color temperature of the light source changes upon some 
operation such as light adjusting performed for the 
microscope 1, white balance is corrected for the 
2 0 designated white portion following this operation. 

Since white balance is detected based on image data of 
a plurality of pixels, white balance can be reliably 
corrected. 

Note that an observation image can be displayed 
25 in which white balance is corrected as in the fifth 

operation example, and color balance is adjusted as in 
the first operation example. An observation image can 
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also be displayed in which white balance is corrected 
as in the fifth operation example, and tone is adjusted 
as in the fourth operation example. Further, an 
observation image can be displayed in which white 
5 balance is corrected as in the fifth operation example, 

color balance is adjusted as in the first operation 
example, and tone is adjusted as in the fourth 
operation example. 

In the fifth operation example, the index arrow A 

10 is moved within the observation image displayed on the 

display unit 48 to designate a white portion subjected 
to white balance detection, and white balance is 
corrected using image data corresponding to the white 
portion. Thus, white balance can be reliably and 

15 easily corrected not to cause fading of a stained 

portion or coloring of a white portion in an image even 
in photographing an image containing many components of 
specific colors, particularly a single color, such as 
a microscopic specimen, or in photographing when the 

20 color temperature of the light source changes upon 

light adjusting for properly setting the observation 
state of the microscope. 

A case in which white balance is corrected in 
transmission bright-field observation will be described 

25 as the sixth operation example of the image sensing 

apparatus for a microscope having the above arrangement. 
Note that the basic operation of the microscope 1 in 
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transmission bright-field observation is the same as in 
the first operation example. 

As shown in FIG. 1, the white balance detector 39 
is connected to the white balance setting unit 49. 
5 The white balance setting unit 49 sets a mode in which 

white balance is corrected automatically following 
changes in color temperature of the light source, and 
a mode in which white balance is corrected only when 
a trigger is input from the operator. In this 

10 arrangement, when the operator sets in the white 

balance setting unit 4 9 the mode for correcting white 
balance automatically following changes in color 
temperature of the light source, the same operation as 
in the fifth operation example is executed, 

15 When the operator sets in the white balance 

setting unit 49 the mode for correcting white balance 
only when a trigger is input from the operator, the 
operator designates a white portion subjected to white 
balance detection with the arrow A displayed in the 

2 0 observation image shown in FIG. 2, as described in the 

fifth operation example. Image data corresponding to 
the designated white portion is read out from the frame 
memory 36 to the white balance detector 39 by the 
memory controller 37. The white balance detector 39 

25 detects white balance based on the image data. 

If white balance is good as a result of detection 
by the white balance detector 39, the gains of the 
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variable gain amplifiers 33a, 33b, and 33c set in 
the gain setting unit 34 are held without any change. 
If white balance is lost, the gain settings of the 
variable gain amplifiers 33a, 33b, and 33c are changed 
5 by the gain setting unit 34 to correct white balance. 

The gains of the variable gain amplifiers 33a, 33b, and 
3 3c are held until the operator inputs a next trigger 
to the white balance setting unit 49. 

After that, if white balance is lost upon changes 

10 in color temperature of the light source caused by 

changing the magnification of the objective lens or 
light adjusting (dimming) in the microscope 1, the 
operator designates again a white portion subjected to 
white balance detection with the arrow A in the 

15 observation image shown in FIG. 2. At the same time, 

the operator inputs a trigger with the white balance 
setting unit 49 to correct white balance for new 
observation conditions. 

In the sixth operation example, even when a white 

2 0 portion subjected to white balance detection in the 

observation image displayed on the display unit 4 8 
moves upon movement of a specimen in microscopic 
observation, the current white balance correction value 
is held until the operator inputs a next trigger to the 

25 white balance setting unit 49. For this reason, the 

operator can continue observing the specimen under 
constant white balance. 
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FIG. 9 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
according to the second embodiment of the present 
invention. In FIG. 9, the same reference numerals as 
5 in FIG. 1 denote the same parts. In the arrangement of 

FIG. 9, an image sensor 31 is connected to a pre- 
processor 32, which is connected to a frame memory 36 
via variable gain amplifiers 33a, 33b, and 33c and an 
A/D converter 35. The frame memory 36 is connected to 

10 a controller 51. The controller 51 is connected to the 

variable gain amplifiers 33a, 33b, and 33c via the gain 
setting unit 34 and to a personal computer (to be 
referred to as a PC) 53 via an I/F (interface) unit 52. 
The controller 51 controls the frame memory 36 and the 

15 gain setting unit 34. The PC 53 is connected to a 

microscope controller 24 of a microscope 1. 

In the PC 53, a CPU (not shown) performs the 
processes of a white balance detector 39, color balance 
adjustment unit 40, chromaticity determination unit 41, 

20 tone adjustment unit 44, and luminance distribution 

determination unit 43 shown in FIG. 1. These processes 
are executed by the CPU in accordance with respective 
processing programs stored in the memory (not shown) of 
the PC 53. The PC 53 incorporates a display processor 

25 46 and D/A converter 47 shown in FIG. 1. A display 

unit 48 corresponds to the monitor (not shown) of the 
PC 53. A white balance setting unit 49, position 
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designation unit 38, adjustment amount input unit 42, 
and adjustment amount input unit 45 shown in FIG. 1 
correspond to the keyboard and mouse (not shown) of the 
PC 53. 

5 In this arrangement, observation image data 

converted into a digital signal by the A/D converter 35 
is stored in the frame memory 36, and input to the PC 
53 via the controller 51 and I/F unit 52. The PC 53 
displays the observation image on the monitor (not 

10 shown). At the same time, the CPU (not shown) controls 

white balance detection described in the first 
embodiment, chromaticity determination and color 
balance adjustment for the pixels of the observation 
image data, and luminance distribution determination 

15 and tone adjustment for the pixels of the observation 

image data. After white balance is detected, the CPU 
(not shown) of the PC 53 sets the gains of the variable 
gain amplifiers 33a, 33b, and 33c in the gain setting 
unit 34 via the I/F unit 52 and controller 51. 

2 0 This arrangement can also attain the same effects 

as in the first embodiment. The arrangement of the 
first embodiment applies to observation of a moving 
picture. In the second embodiment, a still image can 
be stored in the memory (not shown) of the PC 53, and a 

25 still observation image can be effectively used. 

FIG. 10 is a block diagram showing the arrangement 
of an image sensing apparatus for a microscope 
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according to the third embodiment of the present 
invention. In FIG. 10, the same reference numerals as 
in FIG. 1 denote the same parts. In the arrangement of 
FIG. 10, a frame memory 63 is arranged between the tone 
5 adjustment unit 44 and the display processor 46, and 

connected to a storage medium 62 via a controller 61. 
The storage medium 62 is made of a magnetic disk or the 
like, and stores respective image data stored in the 
frame memory 36. The controller 61 outputs to the 

10 storage medium 62 a control signal for writing image 

data of the frame memory 36 as still image data in the 
storage medium 62, and a control signal for reading out 
still image data stored in the storage medium 62 to the 
frame memory 36. 

15 With this arrangement, a moving picture can be 

observed similar to the arrangement of the first 
embodiment. In addition, a still image can be stored 
in the storage medium 62, and a still observation image 
can be effectively used. That is, the output unit of 

2 0 the image sensing apparatus is the display unit 48 in 

the first embodiment. However, this output unit can be 
made of the storage medium 62 to apply the arrangement 
of the image sensing apparatus to an electronic still 
camera and the like. 

25 The present invention is not limited to the first 

to third embodiments, and can be modified as follows. 
For example, in the first embodiment, the criterion for 
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determining chromaticity or the luminance distribution 
is set for each microscopy technique. Alternatively, a 
plurality of criteria may be set based on not only the 
microscopy technique but also filter information of the 
5 microscope, light quantity information, objective 

information, and the like* The first embodiment has 
exemplified transmission bright-field observation and 
fluorescent observation as microscopy techniques. 
However, in terms of pixel determination corresponding 

10 to the microscopy technique, the observation method is 

not limited to the one described in the first 
embodiment. The present invention can be applied to 
various known observation methods such as phase 
contrast observation. 

15 As has been described above, the present invention 

can provide an image sensing apparatus for a microscope, 
which can provide a smooth observation environment 
corresponding to each microscopy technique without 
demanding any extra labor of the operator in sensing an 

2 0 observation image obtained from the microscope which 

can be freely switched to an arbitrary microscopy 
technique among various microscopy techniques such as 
transmission bright-field observation and fluorescent 
observation . 

2 5 According to the present invention, white balance 

can be reliably and easily corrected without causing 
fading of a stained portion or coloring of a white 



portion in an image even in photographing an image 
containing many components of specific colors, such as 
a microscopic specimen,, or in photographing when the 
color temperature of the light source changes upon 
light adjusting (dimming) for properly setting the 
observation state of the microscope* 

Additional advantages and modifications will 
readily occur to those skilled in the art* Therefore, 
the invention in its broader aspects is not limited to 
the specific details and representative embodiments 
shown and described herein. Accordingly, various 
modifications may be made without departing from the 
spirit or scope of the general inventive concept as 
defined by the appended claims and their equivalents. 



WHAT IS CLAIMED IS: 
1. An image sensing apparatus for a microscope, 
comprising: 

an image sensing unit for sensing an observation 
image obtained by a microscope and obtaining the 
observation image; 

a display unit for displaying the observation 
image obtained by said image sensing unit; 

a microscopy technique determination unit for 
detecting a microscopy technique in the microscope; 

a chromaticity determination unit for determining 
chromaticity of the observation image on the basis of 
the microscopy technique detected by said microscopy 
technique determination unit|. and determining a region 
where color balance is to be adjusted in the 
observation image ; 

a color balance adjustment unit for adjusting 
color balance in accordance with a color balance 
adjustment amount arbitrarily set for the region of the 
observation image determined by said chromaticity 
determination unit; 

a luminance distribution determination unit for 
calculating a luminance distribution of the observation 
image on the basis of the microscopy technique detected 
by said microscopy technique determination unit, and 
determining from the luminance distribution a region 
where tone is to be corrected in the observation image; 
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a tone adjustment unit for correcting tone in 
accordance with a tone correction amount arbitrarily 
set for the region of the observation image determined 
by said luminance distribution determination unit; 
5 a white balance correction unit for correcting 

white balance for the observation image sensed by said 
image sensing unit; 

a position designation unit for designating a 
desired position in the observation image displayed on 
10 said display unit; and 

a control unit for detecting white balance on the 
basis of image data at the position designated by said 
position designation unit, and controlling said white 
balance correction unit. 
15 2. An image sensing apparatus for a microscope, 

comprising: 

an image sensing unit for sensing an observation 

image obtained by a microscope and obtaining the 

observation image ; 
2 0 a microscopy technique determination unit for 

detecting a microscopy technique in the microscope; 

a chromaticity determination unit for determining 

chromaticity of the observation image on the basis of 

the microscopy technique detected by said microscopy 
2 5 technique determination unit, and determining a region 

where color balance is adjusted in the observation 

image ; and 
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a color balance adjustment unit for adjusting 
color balance in accordance with a color balance 
adjustment amount arbitrarily set for the region of the 
observation image determined by said chromaticity 
5 determination unit. 

3. An apparatus according to claim 2, further 
comprising: 

a luminance distribution determination unit for 
calculating a luminance distribution of the observation 
10 image on the basis of the microscopy technique detected 

by said microscopy technique determination unit, and 
determining from the luminance distribution a region 
where tone is to be corrected in the observation image; 
and 

15 a tone adjustment unit for correcting tone in 

accordance with a tone correction amount arbitrarily 
set for the region of the observation image determined 
by said luminance distribution determination unit- 

4, An apparatus according to claim 2, further 
20 comprising: 

a display unit for displaying the observation 
image obtained by said image sensing unit; 

a white balance correction unit for correcting 
white balance for the observation image sensed by said 
2 5 image sensing unit; 

a position designation unit for designating a 
desired position in the observation image displayed on 
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said display unit; and 

a control unit for detecting white balance on the 
basis of image data at the position designated by said 
position designation unit, and controlling said white 
5 balance correction unit. 

5. An image sensing apparatus for a microscope, 
comprising: 

an image sensing unit for sensing an observation 
image obtained by a microscope and obtaining the 
10 observation image; 

a display unit for displaying the observation 
image obtained by said image sensing unit; 

a white balance correction unit for correcting 
white balance for the observation image sensed by said 
15 image sensing unit; 

a position designation unit for designating a 
desired position in the observation image displayed on 
said display unit; and 

a control unit for detecting white balance on the 
20 basis of image data at the position designated by said 

position designation unit, and controlling said white 
balance correction unit. 

6. An apparatus according to claim 5, wherein 
said control unit can hold white balance corrected by 

25 said white balance correction unit. 

7. An apparatus according to claim 5, wherein 
said position designation unit designates a range 
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corresponding to a plurality of pixels at the desired 
position in the observation image. 

8. An apparatus according to claim 7, wherein 
said control unit can hold white balance corrected by 

5 said white balance correction unit. 

9. An apparatus according to claim 5, further 
comprising: 

a microscopy technique determination unit for 
detecting a microscopy technique in the microscope; 

10 a luminance distribution determination unit for 

calculating a luminance distribution of the observation 
image on the basis of the microscopy technique detected 
by said microscopy technique determination unit, and 
determining from the luminance distribution a region 

15 where tone is to be corrected in the observation image; 

and 

a tone adjustment unit for correcting tone in 
accordance with a tone correction amount arbitrarily 
set for the region of the observation image determined 
20 by said luminance distribution determination unit. 

10. An image sensing apparatus for a microscope, 
comprising: 

an image sensing unit for sensing an observation 
image obtained by a microscope and obtaining the 
25 observation image; 

a microscopy technique determination unit for 
detecting a microscopy technique in the microscope; 
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a luminance distribution determination unit for 
calculating a luminance distribution of the observation 
image on the basis of the microscopy technique detected 
by said microscopy technique determination unit, and 
determining from the luminance distribution a region 
where tone is to be corrected in the observation image; 
and 

a tone adjustment unit for correcting tone in 
accordance with a tone correction amount arbitrarily 
set for the region of the observation image determined 
by said luminance distribution determination unit. 



- 53 - 

ABSTRACT OF THE DISCLOSURE 
An image sensing apparatus for a microscope of 
this invention includes an image sensing unit for 
sensing an observation image obtained by a microscope 
and obtaining the observation image, a microscopy 
technique determination unit for detecting a microscopy 
technique in the microscope, a chromaticity determi- 
nation unit for determining chromaticity of the 
observation image on the basis of the microscopy 
technique detected by said microscopy technique 
determination unit, and determining a region where 
color balance is adjusted in the observation image, 
and a color balance adjustment unit for adjusting 
color balance in accordance with a color balance 
adjustment amount arbitrarily set for the region of 
the observation image determined by said chromaticity 
determination unit. 
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As a below named inventor, I hereby declare that: 



My residence, post office address and citizenship 
are as stated below next to my name. 



I believe I am the original, first and sole inventor 
(if only one name is listed be low) or an original, 
first and joint inventor (if plural names are listed 
be^a;^^of the subject matter vvhich is claimed and for 
v.hich a patent is sought on the invention entitled 

IMAGE SENSING APPARATUS FOR 

MICROSCOPE 



The specification of which is attached hereto 
unless the following box is checked: 



□ was filed on 



as United States Application Number or 
PCT international Application Number 



and was amended on 
( i f app 1 i cab 1 e) . 



I hereby state that I have reviei^N-ed and understand 
the contents of the above identified specification 
including the claims, as amended by any amendment 
referred to above. 



I acknowledge the duty to disclose infoiToation 
which is material to patentab 1 i 1 ty as defined 
in Title 37, Code of Federal Regu 1 at ions. Sect ion 
1. 56 
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I hereby claim the benefit under Title 35, United 
States Code, Section 120 of any United States 
appl ication (s) or 365(c) of any PCT international 
application designating the United States, listed 
below and, insofar as the subject matter of each of 
the claims of this application is not disclosed in 
the prior United States or FCT InfonTiation application 
in the manner provided by the first paragraph of 
Title 35, United States Code, Section 112, I 
acknowledge the duty to disclose information 
which is material to patentability as defined 
in Title 37, Code of Federal Regulations, Section 
1. 56 which become available between the filing 
date of the prior application and the national 
or PCT international filing date of application: 



(App 1 i cat i on No. ) 



(Fi i ing Date) 
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I hereby declare that all statements made herein 
of my own know^ledge are true and that ail 
statements made on information and belief are 
believed to be true; and further that these 
statements were made with the knowledge that 
willful false statements and the like so made 
are punishable by fine or imprisonment, or both, 
under Section 1001 of Title IS of the United 
States Code and that such willful false statements 
may jeopardize the validity of the application 
or an>' patent issued thereon. 
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